Gesture-Controlled Interfaces for Self-Service Machines 

Potential advantages include immunity to wear and increased safety. 
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A User Would Control an Automated Teller Machine through gestures. Panels on the sides of the ma- 
chine would depict static and dynamic hand and arm signals recognized by the system. 


Gesture-controlled interfaces are soft- 
ware-driven systems that facilitate device 
control by translating visual hand and 
body signals into commands. Such inter- 
faces could be especially attractive for 
controlling self-service machines (SSMs) 
— for example, public information 
kiosks, ticket dispensers, gasoline 
pumps, and automated teller machines 
(see figure). 

A gesture-controlled interface would 
include a vision subsystem comprising 
one or more charge-coupled-device 
video cameras (at least two would be 
needed to acquire three-dimensional 
images of gestures). The output of the 
vision system would be processed by a 
pure software gesture-recognition sub- 
system. Then a translator subsystem 
would convert a sequence of recognized 
gestures into commands for the SSM to 
be controlled; these could include, for 
example, a command to display re- 
quested information, change control 
settings, or actuate a ticket- or cash-dis- 
pensing mechanism. 

Depending on the design and opera- 
tional requirements of the SSM to be 
controlled, the gesture-controlled inter- 
face could be designed to respond to 
specific static gestures, dynamic ges- 
tures, or both. Static and dynamic ges- 
tures can include stationary or moving 
hand signals, arm poses or motions, 
and/or whole-body postures or motions. 
Static gestures would be recognized on 
the basis of their shapes; dynamic ges- 
tures would be recognized on the basis 
of both their shapes and their motions. 
Because dynamic gestures include tem- 
poral as well as spatial content, this ges- 
ture-controlled interface can extract 
more information from dynamic than it 
can from static gestures. 

Gesture-controlled interfaces offer 
several advantages over other input de- 
vices commonly used in SSMs: 

• There would be no mechanical wear 
because unlike a keyboard, push-but- 
ton switch, and/or computer mouse, a 
gesture-controlled interface contains 
no moving parts. 

• Inasmuch as there would be no direct 
contact with users, there would be no 


problem of hygiene as there is with a 
touch screen. 

• Unlike a speech-recognition system, a 
gesture-controlled interface could op- 
erate in a noisy location because it 
does not respond to sound. 

• The safety of users of automated teller 
machines could be increased because 
the translator subsystems of gesture- 
controlled interfaces could be made to 
recognize poses and motions associ- 
ated with the crimes committed at 
such machines. 

• Systems will be designed to recognize 
gestures that are natural to users, 
thereby decreasing the time required 
to learn how to operate SSMs. The 
area of an SSM surrounding a display 
screen could contain pictures of hand 
signals or other gestures recognized by 
the system. 


• The use of gestures as a communica- 
tion medium may help to overcome 
language barriers to the use of SSMs in 
communities with diverse populations. 
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